Optimal scaling of discrete approximations to Langevin diffusions
نویسندگان
چکیده
We consider the optimal scaling problem for proposal distributions in Hastings-Metropolis algorithms derived from Langevin diffusions. We prove an asymptotic diffusion limit theorem and show that the relative efficiency of the algorithm can be characterised by its overall acceptance rate, independently of the target distribution. The asymptotically optimal acceptance rate is 0.574. We show that as a function of dimension n, the complexity of the algorithm is O(n), which compares favourably with the O(n) complexity of random-walk Metropolis algorithms. We illustrate this comparison with a number of example simulations.
منابع مشابه
Tempered Langevin diffusions and algorithms
We consider a class of Langevin diffusions with state-dependent volatility. The volatility of the diffusion is chosen so as to make the stationary distribution of the diffusion with respect to its natural clock, a heated version of the stationary density of interest. The motivation behind this construction is the desire to construct uniformly ergodic diffusions with required stationary densitie...
متن کاملOptimal scaling of discrete approximations to Langevin di usionsbyGareth
Acknowledgements. We are grateful to Radford Neal for bringing references from the physics literature to our attention. We also thank Richard Gibbens, Michael Miller, and Richard Tweedie, for helpful discussions, and would like to thank the referees very much for their work. Abstract. We consider the optimal scaling problem for proposal distributions in Hastings-Metropolis algorithms derived fr...
متن کاملOptimal Scaling of the Mala Algorithm with Irreversible Proposals for Gaussian Targets
Abstract. It is known that reversible Langevin diffusions in confining potentials converge to equilibrium exponentially fast. Adding a divergence free component to the drift of a Langevin diffusion accelerates its convergence to stationarity. However such a stochastic differential equation (SDE) is no longer reversible. In this paper, we analyze the optimal scaling of MCMC algorithms constructe...
متن کاملGaussian Approximations of Small Noise Diffusions in Kullback-leibler Divergence
Abstract. We study Gaussian approximations to the distribution of a diffusion. The approximations are easy to compute: they are defined by two simple ordinary differential equations for the mean and the covariance. Time correlations can also be computed via solution of a linear stochastic differential equation. We show, using the Kullback-Leibler divergence, that the approximations are accurate...
متن کاملFast Communication Gaussian Approximations of Small Noise Diffusions in Kullback–leibler Divergence∗
We study Gaussian approximations to the distribution of a diffusion. The approximations are easy to compute: they are defined by two simple ordinary differential equations for the mean and the covariance. Time correlations can also be computed via solution of a linear stochastic differential equation. We show, using the Kullback–Leibler divergence, that the approximations are accurate in the sm...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1995